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(54) Non-contact surface flaw detection. 

(g) A non-contact surface flaw detection system 
for workplaces such as nuclear fuel pellets 
transports the pellets continuously along an 
illuminated path while rotating them. A line 
scan camera records a series of line scans for 
the pellets and the resulting values of pellet 
reflectivity are digitized. Pixel values are com- 
pared to thresholds defined adaptively by 
averaging and/or using a video finite impulse 
response filter, to generate a binary map of 
"good" and "bad" pixels, that also defines the 
edges of the pellet in the map. A processor 
counts and associates bad pixels to logically 
define and assess blobs of bad pixels. The 
processor checks for coincidence of the edge 
pixels with a nominal edge line that best fits the 
edge, for finding edge flaws. The pellets asses- 
sed in this manner are selected or rejected. 
Camera sensor elements are normalized for 
gain and offset Shifting of the pixel data can- 
cels skew produced in scanning moving pellets. 
Convolution filters cancel isolated bad pixels 
and enhance contrast at the edge. For proces- 
sing adjacent areas, the pixel image of the 
pellets can be tiled, flaws bridging the tile 
boundaries being assessed as a single blob. 
The apparatus is preferably arranged for paral- 
lel pipeline processing for sidewall and edge 
defects and can be embodied in a series of 
modular VME boards. 
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The invention relates to the field of automated analysis of workpieces for optically detectable flaws, and 
in particular to the optical detection and assessment of sidewall and edge flaws in cylindrical nuclear fuel pel- 

lets 

In the manufacture of nudearf uel rods, nuclearf uel pellets are formed from a matrix of enriched or natural 
5 uranium oxide and are inserted into elongated hollow tubes typically made of an alloy of zirconium, to be used 
as fuel rods. The pellets are short cylinders and are stacked in the tubes. The tubes are sealed at the ends 
with end plugs, and pressurized. A plurality of fuel rods are arranged in an array to form the fissionable core 

of a nuclear reactor. J . , . . 1U . 

Defects in the pellets, such as fissures or cracks, can result in chips becoming dislodged from the pellets 
10 during reactor operation. Such chips can adversely affect the operation of the reactor. For example, a chip 
dislodged from a fuel pellet can become lodged within the fuel rod adjacent the interior wall of the rod. The 
fissionable material in the dislodged chip continues its fission reaction under the influence of nuclear flux in 
the reactor core. Heat generated at the chip can create a localized area of intense heat on the wall of the fuel 
rod. This weakens the rod at the point of the chip and may cause a rupture of the rod wall and a leak of high 
is pressure gas from the rod. If this occurs, the reactor may have to be shut down. 

Other pellet defects, which may be visible at the surface of the pellets, also can cause adverse effects. 
For example, the inclusion of metal in the pellet surface may adversely affect the normal fission reaction of 
the uranium. The pellets must be free of defects such chips, cracks, etc. for optimal operation of the reactor. 
Conventionally, pellets are inspected visually by human inspectors. Specially dressed inspectors visually ex- 
20 amine illuminated trays of lengthwise stacked pellets and manually remove any that are apparently defective. 
After one side of the pellets is viewed, the trays are covered and flipped over, for viewing the opposite side. 

The results of manual inspection of the pellets in this manner are inconsistent due to the subjectivity in- 
herent in human visual inspection. Moreover, manual inspection requires prolonged exposure of the inspectors 
to the low level radiation produced by the pellets, as well as potential ingestion of dust which the pellets pro- 
25 duce Also the trays are heavy and physically manipulating them is strenuous and presents a nsk of injury. 

US Patent Application SN 07/640.770, filed January 14. 1991 and entitled Pellet Inspection System, dis- 
closes an automated transport arrangement for presenting pellets serially for inspection using an automated 
viewing apparatus. The disclosure of said Application is hereby fully incorporated. According to the disclosure, 
the pellets are fed along a conveying means that rotates and axially feeds the pellets as they pass in front of 
30 a line scanning camera. The image of the pellets is digitized as a series of sets of discrete digital values rep- 
resentative of axially extending linear portions covering the peripheral surface of each passing pellet The dig- 
ital values, which represent the reflectivity of the pellets in a small area or pixel according to a numerical gray 
scale are collected and their values are averaged. High and low reflectivity thresholds are defined from the 
average, and the pixel values are compared to the thresholds thus defined. The number of pixels that fall out- 
35 side the threshold are counted, and if the number exceeds a predetermined value the respecbve pellet is re- 
jected The system is arranged such that the pellets are axially separated from one another as they are fed, 
whereby it is also possible to use the system to check for proper pellet dimensions without the need to detect 

the axial ends of the pellet 

Additional examples of optical inspection systems for cylindrical pellets and the like are disclosed in US 

40 Patents 4.496.056 and 4,549,662 - both to Schoenig, Jr. et al. and 4,448,680 - Wills et al. 

The present invention is directed to a non-contact surface flaw detection system for workpieces such as 
nuclear fuel pellets that transports the pellets continuously along an illuminated path while rotating them. A 
line scan camera records a series of line scans for the pellets and the resulting values of pellet reflectivity are 
digitized Pixel values are compared to upper and lower thresholds that are defined adaptively, for example 

45 pixels within a predetermined range about the average value. In addition, a video finite impulse response fil- 
tering process can be applied to reduce noise present in the image. The threshold comparison generates a 
binary map of "good" and "bad" pixels, the latter being those outside the two thresholds. The binary map also 
defines the edges of the pellet in the map. A processor counts and associates bad pixels to logically define 
and assess groups or 'blobs' of pixels outside the thresholds. The processor also checks for coincidence of 

so the edge pixels with a nominal edge line that best fits the edge, for finding edge flaws. The pellets assessed 

in this manner are selected or rejected. 

The individual sensor elements of the line scanning camera are tested for gain and offset and thereafter 
incoming data from the respective sensor elements is normalized to cancel variations among the sensor ele- 
ments Shifting of the pixel data cancels skew produced In scanning moving pellets to enable the image to 
55 be processed as an elevation or plan view. Convolution filters are applied to the pixel data and/or to t he binary 
map to cancel isolated bad pixels and to enhance contrast at the edges of the pellet 

For processing adjacent areas,, the pixel imagedf the pellets can be tiled, or collected in successive subset 
images that are processed one at a time. Adjacent flaws bridging across the tile boundaries are associated 
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together and assessed as a single blob. The apparatus is preferably arranged for parallel pipeline processing 
for sldewall and edge defects and can be embodied in a series of modular VME boards. 

In discussing image collection and analysis according to the invention, pellet defects are grouped generally 
into two categories, namely sidebody surface flaws and edge defect flaws. Sidebody surface flaws include, 
for example, circumferential cracks, longitudinal cracks, connected or branched fissures, thumbnail cracks. 
Drtting and sidebody indications, end capping, circumferential surface chips, unground surfaces, and metal 
inclusions. Edge defectf laws can be end chips, chatter and the like. This nomenclature is used for convenience 
in discussing the invention. However, it will be appreciated that the system is useful generally for detecting 
and selecting for optically detectible attributes of any type. 

A wide variety of specific tests may be applied to the pellets to assess quality, and it is possible to be 
more or less demanding in the selection or rejection of pellets. The invention is described in a manner that 
permits a range of tests; however only certain exemplary test criteria are specifically discussed as examples. 
For example, the character of defect found, the size of the defect, its orientation, the number of defects found . 
the potential relationship of defects, whether the defect is relatively bright or dark. etc.. are all potential quality 
parameters of interest that can be examined. 

The invention is also discussed with reference to a preferred embodiment wherein a substantial portion 
of the image processing steps are arranged as functions of a modular VME board system. Similar processing 
functions can be embodied using other divisions of hardware and software elements. 

There are shown in the drawings certain embodiments of the invention as presently preferred. It should 
be understood, however, that the invention is not limited to the precise arrangements and instrumentalities 
shown, which are intended as exemplary. In the drawings, 

FIGURE 1 is schematic block diagram showing the hardware and software functional blocks of a method 
and apparatus for non-contact surface flaw detection according to the invention. 

FIGURE 2 is a schematic illustration of an illumination and camera means operatively onented toward a 

pellet to be examined. 

FIGURES 3a-3c are related segments of a schematic illustration of signal processing units in a modular 
VME data handling system according to the invention, showing the data handling pipelines. 

FIGURE 4 is a diagrammatic illustration showing skewing of linescan data in an image buffer due to linear 

motion of the pellet . m _ . . 

FIGURE 5 is a diagrammatic illustration demonstrating correction of the skewing shown in FIGURE 4 by 

introducing a plural-pixel delay. 

FIGURE 6 is a functional block diagram showing the separate data processing pipelines according to the 

invention for sidebody defect detection and edge defect detection. 

FIGURE 7 is a graph showing application of pixel gray scale data to a dual threshold. 

FIGURE 8 is a table showing a convolution mask applied to the pixel data for removing apparent defects 

represented by isolated single pixels. 

FIGURE 9 is an illustration of tiling of a pixel array for identifying blob defects that may extend across 

the border between adjacent tiles. . 

FIGURE 10 is a table showing a convolution mask applied to the pixel data for emphasizing contrast de- 
fining edges of the pellet being examined. .... 

FIGURES 11a and 11b are related segments of a functional block diagram showing a decision tree used 

to evaluate potential pellet defects. 

FIGURE 1 shows the general hardware and functional elements of a non-contact surface flaw detection 
system according to the invention. The front-end lighting and optical system 22 acquires images of substan- 
tially cylindrical pellets 24 as they are rotated on their axes and translated axiaHy by a material handl.ng system 
26 The optical system 22 as shown schematically in FIGURE 2. comprises an illumination source 28 and a 
camera 32 mounted to detect changes in the reflectivity of the surface 42 of the pellet 24. Preferably, the il- 
lumination source 28 and the camera 32 are mounted at equal angles of incidence relative to a tangent 44 to 
the pellet at the point being examined, tending to maximize light transmission to the camera 32 when the sur- 
face is smooth, and providing good contrast in the event of a crack, chip or similar discontinuity. The reflected 
lioht level varies as a function of reflectivity of the surface due to material composition, and due to disconti- 
nuities in the surface causing light to scatter as shown In FIGURE 2. The discontinuities are thereby detectable 
as brighter or darker light levels received at the camera. 

This arrangement is important to the successful inspection of pellets. The images provided by this optical 
arrangement provide good contrast between the normal pellet surface and all of the side surface flaws men- 
tioned above, as well as the necessary gray level contrast to detect all of the specified edge defects 

The images from the front-end optical system 22 are digitized by an image acquisition system 50 and 
stored in an image buffer 52. Upon receiving a "PELLET CLOCK" signal, which can be generated using a pho- 
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tocell pair detecting passage of a peiiet or by a proximity sensor, the image processing controller 54 initiates 
a transfer of the most recently completed pellet image for processing. The image data is processed In both a 
surface flaw data pipeline 62, which is configured to detect potential sidebody defects, and an edge flaw de- 
tection data pipeline 64, which is configured to detect pellet edge boundary defects. 

Image acquisition for peiiet defect analysis can use commercially available high speed image acquisition 
hardware, such as the MaxVideo line of modular VME boards marketed by Data Cube, Inc. The camera 32 
preferably is a line scan camera such as a Fairchild CAM 1 500R or CAM 1 830 line scan camera, having a 2,048 
X 1 line of sensor cells. The light source 28 can be a high frequency fluorescent light source such as a fluor- 
escent tube driven by a high frequency (e.g., 60 KHz) driver, such as available from Mercron, thereby enabling 
several cycles of illumination during each line scan cycle. The sensors in the camera 32 develop a charge as 
a function of the light level focused on them, and the charges can be shifted serially out of the respective sen- 
sors for digitization using an analog to digital converter 86, for numerical analysis and processing. 

FIGURES 3a-3c illustrate preferred image processing functions in an arrangement wherein the functions 
are embodied in MaxVideo modules that are coupled to define the image data processing pipelines 62, 64. In 
general, the boards along the pipelines embody logical and mathematical functions which examine the pellet 
linescan images for defective areas characterized by reflectivity variations. When processing is complete 
along the two processing pipelines, potentially defective areas or "blobs" 70 have been identified, and prefer- 
ably also measured and classified. A processor at the end of the data stream compares the results of the image 
processing steps to stored information representing the maximum acceptable defect criteria. Pellets 24 char- 
acterized by a sufficient number or type of reflectivity variations to be considered defective are flagged for 
subsequent rejection. 

The linescan camera 32 is interfaced to the image processing system through an image processor 74 such 
as a MAX-SCAN module. This eliminates the need for a linescan camera controller box. Such controller boxes 
typically are not made for an industrial inspection system as provided according to the invention. Ashortcoming 
of typical linescan controller boxes is that they typically operate at less than the maximum data rate of which 
the camera is capable. The typical control box. for example, is capable of timing signals that allow a 3 MHz 
pixel data rate, while the camera may be capable of speeds up to 20 MHz. 

Coupling the camera 32 directly to the MAX-SCAN module 74 also allows the system processor 74 or the 
image acquisition control circuitry 54 to vary operation as may be required, for example to accommodate dif- 
ferent pellet transport speeds or the like by varying the pixel data rate. With a camera controller box, important 
system parameters such as the pixel clock rate and line exposure time must be set manually via knobs on the 
controller box front panel or the like. Since these parameters are not controlled directly by the image proc- 
essing system, improper setup could result. 

For these reasons, the system according to the invention controls the camera 32 via the MAX-SCAN in- 
terface 74 or similar control arrangement having an on board frequency synthesizer. The system thus has 
the capability of modifying the camera's scan rate and exposure time under system control. The system also 
can be provided with feedback control loops, for example to operate the camera at timing and exposure levels 
that ensure the required scanning density and maintain an average pixel level that minimizes the extent to 
which light and dark pixels may go off scale. If the camera requires or permits parallel processing, for example 
of the even and odd numbered pixels, the MAX-SCAN form of interface also can sample the two separate 
data streams coming from the sensor and interleave them into a single coherent image. 

The dock signal echoed from the camera 32 is used to dock an analog to digital (A/D) converter 66 on 
the MAX-SCAN board. Using the camera's dock compensates for any delay introduced by cable length (be- 
cause the dock signal travels the same length as the data signal). This allows the pixel clock used by the A/D 
to remain in phase with the data, and also allows high frequency operation. Shielded twisted pair cabling and 
differential driver circuits are preferred for optimal noise immunity. 

The MAX-SCAN module 74 converts the analog signal levels generated by the CCD elements of the cam- 
era 32 to digital numeric data. More particularly, the MAX-SCAN interface module 74 produces digital data 
that is compatible with the system bus, i.e., a MAXbus compatible digital signal. 

The interface module (MAX-SCAN) 74 also provides for pixel- by-pixel gain and offset compensation. Gain 
and offset compensation on a pixel-by-pixel level is extremely useful in surface inspection of nudear fuel pel- 
lets and the like, allowing an increase In sensitivity of the system by compensating for photo response non- 
uniformities among the sensor elements or due to system optics. Diffuse reflectance standards in the optical 
arrangement allow calibration for each individual pixel of the linescan camera 32 (off-line). The pixel perfor- 
mance and the specific character and. setup of the illumination source 28 and optics are thereby normalized 
for all the pixels of the camera sensor, compensating for photo response non-uniformities. Once calibration 
is performed, the resulting gain/offset data, as loaded into the digitization hardware (MAX-SCAN), allows in- 
dividual pixel corrections to be accomplished in real-time during subsequent on-line system operation. 
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The sensor calibration procedure gives the system the ability to compensate for the inherent non-unlform- 
tties In the front-end optical sensor system, the net result being a very uniform image field, independent of 
any radiometric perturbations caused by the lighting, optics, or sensor element variations. 

Preferably, the pellets 24 are scanned while rotating and in linear motion. The invention provides a unique 

s solution to the image skew problem encountered in line scanning of the moving pellets. If the pellets were 
held stationary in front of the camera 32 and rotated without any forward motion, image skew would not occur. 
However advance of the pellet in the time between scans must be taken into account if the data is to be mapped 
directly into an elevation-type X-Y memory array of the pixel image. 

FIGURE 4 illustrates how successive images of moving pellets 24 normally map to the data in the image 

10 buffer 52. As a pellet enters the horizontal f ield-of-view of the line scan camera 32, e.g., moving from right to 
left in FIGURE 4, the f irst row of pixels to contain reflectivity data on a given pellet will contain only a limited 
number of pellet pixels (e.g., one or two) along the right hand edge of the row. When the next line of pixels is 
acquired from the camera (for example about 1 msec later), the pellet 24 has moved to the left by an amount 
determined by the rate of linear advance of the pellets, for example by 7.5 mils. Therefore, in the next row 

is three more pixels contain data on the pellet than in the previous row. Moreover, the pixels for the successive 
rows are misaligned with the previous row. On encountering the leading edge of the pellet, the increase in the 
number of active pixels continues until the pellet is completely within the camera's f ield-of-view, at which time 
each successive row contains the same number of pixels, but each row is shifted left three pixel positions on 
the pellet relative to the previous row's pixels. In FIGURE 5, the result is a leading series of pixels 82 that is 

20 skewed. As the pellet leaves the f ield-of-view, the number of pixels in each row containing pellet data likewise 
decreases by three, until the pellet is completely out of the f ield-of-view. 

The signal processing architecture of the preferred MaxVideo system is characterized by circuits such as 
gating and the like, designed to process rectangular sub-regions of the image buffer, i.e., tabular or aligned 
X-Y memory locations. However with reference to FIGURE 4, a rectangular sub-region of successive locations 

25 does not completely contain one and only one pellet image. According to the invention, the image buffer 52 
is made effectively to output each successive row by a displaced number of pixels relative to the previous row. 
For example, assuming the pellet is transported from left to right relative to the camera, each row is shifted 
right by a number of pixel spaces relative to the previous row that is a function of the transport speed. This 
shift causes the successive pellet line images to align in the stored data, justified to the last pellet pixel in the 

30 row and to the edge of the pellet. The conversion to the skew-corrected image 84 in FIGURE 5 enables simple 
processing of the image in the successive processing modules as if the entire X-Y array of pellet surface data 

had been captured at once. 

The right shift, e.g., of three pixels as shown in FIGURE 5, can be accomplished by causing the MaxVideo 
image buffer (MEGASTORE) 52 to count three more pixels in each row than were actually collected. The image 

35 buffer 52 operates logically by justifying the data to one side of the sensor elements defining the pixel collec- 
tion means; however the image of the moving pellet progresses, and this is corrected according to the inven- 
tion Each successive row of data is then output to downstream processing modules, three pixels to the nght 
of the previous row as shown in FIGURE 5, for processing in a manner that allows spatial convolution masks 
and the like to be applied over X-Y subregions of memory locations in a straightforward manner. This relatively 

40 simple correction implements a first-order correction of the pellet's alignment and enables use of X-Y image 
processing modules such as the Max Video modules in a manner that would not otherwise be possible. 

The problem remains to locate the pellet data in the image buffer 52 and to define a region of interest (ROI) 
that totally contains the pellet to be processed (and no other pellets). By knowing the relevant parameters of 
pellet spacing, rate of advance and camera line scanning frequency, it is possible to predict nominally where 

45 in the image buffer 52 the next pellet to be processed should be stored, relative to the location of the most 
recent pellet processed. The pellet clock also provides a form of synchronization. Predicting the location of 
the pellet image in the buffer 52 is used to narrow the search region so that a binary search can very quickly 
define the pellet ROI. 

Preferably, a number of pellet images are in process at any one time. On each pellet clock signal, the sys- 
50 tern updates the predicted storage location for each of the five pellets being tracked in the image buffer at 
that time. As each pellet proceeds through the f ield-of-view, the ROI that completely encloses that pellet is 
updated on each pellet clock (1 33 msec at 7.5 pellets per second), so that when the pellet leaves the f ield-of- 
view a ROI transfer is immediately initiated to begin the processing cycle for that pellet. 

Having captured, aligned and located pixel data for a pellet, the flaw detection functional elements analyze 
55 the data for variations in surface reflectivity. The flaw detection elements receive sub-images of individual 
pellets from the image buffer defining regions of interest, and detects in the pixel data pattern localized regions 
of potential flaws on the pellet surfaces as represented by variations in reflectivity. Such localized potential 
flaws, which typically are represented in successive line scans, generally may be termed •blobs,- and include 
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such physical characteristics as cracks which may be aligned In any direction, end capping, connected or un- 
connected cracks, pits or voids, metal inclusions, variations In edge or surface smoothness and the like. The 
blobs 70 are identified and processed along image processing pipelines 62, 64 as shown in FIGURE 6. 

Data from the pellet edge detection pipeline 64 is used by the surface flaw pipeline 62 to locate potential 
sidebody and edge defects. Blob data representing aspects of potentially rejectable defects is assimilated 
from the pipelines and passed on to the flaw rejection section, which performs defect determination and dis- 
crimination as explained more fully hereinafter. Preferably, flaw detection involves two separate processing 
pipelines, one detecting the characteristics of surface flaws, the other detecting the characteristics of pellet 
edges. 

The pellet sub-image or region as received from the image buffer completely contains a single pellet im- 
age. Therefore, any sidebody surface flaws occurring within this sub-image belong to a known pellet A buffer 
in the MEGASTORE module is used to convert the sub-image from a ROI format to a standard RS-1 70 format. 
This is desirable to enable use of the Max Video APA-61 2 boards, which support RS-170. Avideo finite impulse 
response (VFIR) module 92, which performs a low-pass filter operation on the spatial distribution of pixels, 
filters the sub-image to remove noise without substantially degrading the image itself, thereby improving the 
signal-to-noise ratio. 

A Max Video SNAP module 94 is coupled into the data stream downstream of the VFIRf ilter 92. The SNAP 
module 94 implements a dual threshold function using its lookup table, as shown in FIGURE 7. Any input pixel 
with a value between the two thresholds T1 and T2 is output as one value (e.g., 255). Any input pixel values 
less than T1 or greater than T2 (or equal to such thresholds) are output as a different value (e.g., zero). The 
specific values of the thresholds can be set at a predetermined value above and below the average "good" 
pixel value, which is learned over time. These out-of-threshold pixels are of interest because they potentially 
belong to or border a flaw 70 or reside in the background (i.e., off the pellet in the i mage collected by the camera 
32). 

To account for gradual surface reflectivity variations, an adaptive threshold defining technique makes use 
of the mean gray values for the normal pellet surface, which is accumulated by sampling the MEGASTORE 
image memory 52. (An alternate solution is to use a FEATUREMAX-MKII module if more speed is required). 
Preferably, the adaptive threshold technique includes a learning factor relating to one or both of the complete 
pellet surface and the duster or area of pixels adjacent the area being examined. On each cycle, the threshold, 
T, can be updated according to the mean value of the normal pellet surface m< as follows: 

sk= (hk-Hc- 1) 
T K - 1 = T K + p * e K 
1 

where M K is the nominal mean of the good pellet surface pixels, p is the learning acceleration factor (p « 
1 .0), and a is the cluster mean learning factor. 

A predetermined minimal defect criteria is preferably defined for side-body flaws. Any isolated flaw that 
is smaller than this minimum pixel size is considered not of interest An exemplary minimum flaw size is 6 mils 
x 15 mils, which translates to a pixel size of 2.4 x 6 pixels. In order to avoid overwhelming the downstream 
APA-512 image processor module 98 with single pixel blobs, the SNAP module 94 can eliminate isolated out- 
of-threshold pixels from consideration by applying a convolution mask to the data. For example, the SNAP 
module can successively check the relationships of pixels within a 3x3 neighborhood, on a pixel by pixel basis 
to identify and cancel isolated pixel flaws such as single pixel blobs. The SNAP mask 102 for this purpose, 
as shown in FIGURE 8, defines a relationship of a single "1" (flaw) pixel, surrounded on all eight possible sides 
by "0" (good) pixels. SNAP module 94 outputs a "0" pixel to replace an isolated *1" whenever the relationship 
of pixels in a local 3x3 neighborhood matches the mask. Thus, isolated flaw pixels are eliminated from the 
image stream. 

The image data processing as described to this point separates flaw pixels from good pixels, and for the 
remainder of the side-body surface flaw pipeline 62, the "good" pixels are no longer of interest Since both 
the good pixels (with a value of 255) and the flaw pixels (with a value of 0) are passed on to the APA-512 image 
processor module 98 with the image data, an additional threshold within the APA-512 can used to separate 
them so that only the patterns of the bad pixels need to be stored for further analysis, which effectively com- 
presses the data and speeds processing. 

The APA-51 2 image processor module 98 accepts the input sub-image (which has already been effectively 
separated into "good" and flaw pixels by the SNAP module), and implements a connectivity analysis function 
to determine whether flaw pixels should be associated together as aspects of a larger defect, and if so to as- 
sess the defect. The APA-512 outputs a number representing a count of the blobs 70 and their associated 
seed parameters (which define characteristics of interest in defining the flaw and in making the decision of 

6 



0597639A1 I _> 



* » 



V, 

EP 0 597 639 A1 



whether to reject the pellet). The output describes the corresponding blob 70 In a manner that allows the sys- 
tem to distinguish between larger or more numerous defects, smaller or less numerous defects, and types of 
defects. It is thus possible to accurately select pellets of higher quality. 

Depending on the optics and the size of the object being inspected, the image size may be greater than 
a the maximum allowed by the image processing board, such as the MaxVideo APA-512 boart 98Jf thte « the 
case, the image is processed tile by tile until processing of the full image is complete. In the case of pe let 
inspection, only two tiles typically are required to completely cover the surface of the lames pellet, induding 
overscan. Any flaws within each tile will generate blob seed parameters as usual. To handle the case of flaws 
that cross the boundary between adjacent tiles as shown in FIGURE 9. a check is made for a corresponding 
10 blob 106 in the adjacent tile 104 when a blob 70 Is found in a first tile adjacent the boundary 108 between 
the tiles. If both tiles contain a blob at or near the boundary, the blob seed parameters for the two tiles 104 
are considered in combination, thereby merging the two blobs to define a larger blob and/or a blob wrth char- 
acteristics generated from the images from both tiles. .. . 

For potentially related blobs in adjacent tiles, a bounding box procedure limits examination of the adjacent 
is tile for blobs to a predetermined distance from the boundary. By comparing the two flaw bounding boxes 110 
of the adjacent blobs and tiles, a quick check is made as to whether or not the two blobs connect across the 
boundary 108 (i.e., whether the bounding boxes overlap). If so. they are combined. If not. they simply are 
counted as individual blobs 70. If there is a question as to overlap, the routine can test boundary pixel values 
and/orflaw pixel locations to determine if the blobs truly connect If they do. the blob parameters are merged. 
20 and a single (large) blob is found and passed on to the routines provided for making the accept/reject decision. 
Otherwise the two are processed as individual (smaller) blobs. The tiling procedure easily accommodates 
flaws that cross the tiling boundary, and merges them where appropriate. Of course, both the occurrence of 
a relatively larger blob and the occurrence of more numerous blobs reflect adversely on the pellet 24. and 
either may be sufficient in a particular instance to cause a rejection decision. 
25 The end result of the surface processing pipeline 62 as described is a list of blobs and associated seed 

parameters describing the blob, each one potentially representing a defect along the side body of the pellet 
With the exception of the merging of blobs located, on the tile borders, all of the described processing can be 
implemented in hardware and operated at a high data rate. For example, gating arrays readily can implement 
the SNAP mask according to FIGURE 8 or the like, whereby the required outputs are generated while simply 
30 shifting the pixel data through memory registers. 

A pipeline 64 is also provided for pellet edge detection processing. The image as received from the image 
buffer 52 by the edge defect pipeline completely contains an image of the pellet. Therefore, any edge defects 
located within this image belong to a known pellet 

The first step in this pipeline is to define a nominal edge of the pellet This is accomplished by using a 
35 video finite i mpulse response filter (VFIR) 92 and another convolution mask. In this case the 'convolution mask 
contains weighting factors designed to enhance pixels that lie on a vertical edge gradient FIGURE 10 shows 
an appropriate mask 122 for emphasizing the vertical edge, i.e.. enhancing the contrast at the edge by pro- 
ducing a larger absolute value or output at vertical edges than at other features, such as horizontal edges. 
Since the edge detection function processes numerical grayscale data, it has a higher tolerance for venations 
40 in average gray level value than a binary system as used for isolated flaw pixels and in the threshold definition 
steps according to the surface data pipeline. It also improves the sub-pixel resolution accuracy of the linear 

rearession function to follow. 

The convolution mask of FIGURES 1 0 is three by three pixels (as was that of FIGURE 8). It is also possible 
to have convolution masks of other sizes. The convolution output for a given pixel according to FIGURE 10 is 

45 produced by multiplying the factors at each position in the convolution mask box. with the value of the pixel 
having the corresponding spatial relationship to the center pixel 124. as defined by the mask box. and then 
adding the sums. The convolution mask factors are weighting factors that favor an aspect which is to be found 
in the image, such as the vertical edge in FIGURE 10. It is also possible to define convolution masks that 
favor other patterns of pixels, such as a hole of a predetermined size, a vertical or horizontal crack etc. By 

« applying such convolution masks to the pixel data, the feature favored by the mask is enhanced in the pixel 
data and is more readily found, measured and otherwise processed. 

The edge detection pipeline preferably uses a FEATUREMAX-MKII module 125. Upon detecting a vertical 
edge the FEATUREMAX-MKII module 1 25 extracts the X/Y coordinates of the left and right edge pixels. Each 
coordinate Is tagged appropriately, according to whether or not it came from the left edge (and has a strong 

55 positive value following the enhancement via convolution according to FIGURE 10). or the right edge (which 

has a strong negative value). . 

Once the coordinates of the pellet edge are available, a second order correction may be des.rable to cor- 
rect for image skew. This is desirable if t he f irst order correction assumed a constant linear translation speed. 
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and minor variation in linear speed occurs. A single pixel error can result from as little as 0.1% variation in 
translation speed, causing a spatially periodic disturbance in the pellet edge locations. There is also a potential 
error of ±1 pixel position due to digitization. If, on a given row, both the left and right edges are displaced in 
the same direction and by the same amount, and the difference between the two edges corresponds to the 

5 expected pellet length, then the displacement can be corrected for that row. Thus the rows are aligned as a 
processing step prior to examining them for defects. 

The corrected coordinates of the left edge pixels are input to a linear regression routine to determine the 
nominal line in the image space that best describes the left edge of the pellet, normally a straight line. The 
process is repeated for the right edge pixel coordinates. The edge lines isolate the background pixels from 

10 the pellet surface pixels. Any edge defects can be detected in essentially the same manner as surface sidebody 
flaws, i.e., by finding and associating areas or blobs 70 which depart from nominal characteristics. 

An alternate method of processing for edge flaws is to use the foregoing edge lines to update a mask gen- 
erated by a MAX-GRAPH module 126. This mask can be binary, and functionally describes where in the image 
memory the outermost pellet pixels of an ideal pellet would reside along each edge of the pellet 24 (as defined 

15 by the best-fit edge lines). It is then a simple matter to determine on a pixel-by-pixel basis if the edge pixels 
actually found are along the smooth ideal edge lines, or are displaced outwardly or inwardly by one or more 
pixel positions. The number of displaced edge pixels and the parameters of blobs of associated displaced edge 
pixels are determined for assessing edge defects. 

An arithmetic logic unit (ALU) such as contained in the MAX-SP module preferably is used in a logical- 

20 AND mode to compare the two binary sub-images, one sub-image representing where pellet pixels are ideally 
expected, and the other indicating where pellet pixels actually are found in the particular pellet. The output of 
this operation is a logical "1" for each pixel that was found in the desired location, and a logical "0" for each 
pixel where a pellet pixel was supposed to be found but was not found. The logical "0" pixels are, by definition, 
edge defect pixels. The FEATUREMAX-MKII module 125 can be used to count the edge defect pixels and the 

25 number of edge defect pixels is passed on to be factored into the accept/reject decision. 

The flaw rejection function is based on the blob data on potential surface and edge pellet defects from 
the flaw detection sections. The flaw rejection processor converts blob seed parameters to defect parameters, 
compares the defect parameters to user programmable rejection criteria such as the size, type and number 
of defects, etc., and generates an accept/reject decision for the pellet This decision, along with supporting 

30 defect parameter data, is placed into a first-in-first-out (FIFO) queue 132 or shift register that is synchronized 
with the transport of the pellets. A "REJECTION ENABLE" signal is shifted through the FIFO 132 along with 
the advance of the corresponding rejected pellets, and activates a reject mechanism 134 at the appropriate 
time to reject a defective pellet, e.g., by diverting the pellet from the stream of accepted pellets. 

For each potential defect (PD), blob seed parameters and computed parameters are compared against 

35 predetermined rejection criteria, which preferably is programmable. As shown in Table I, the number, character, 
dimensions and relationships of defects are factored into the accept/reject decision. Any blob or plurality of 
blobs that meets the predetermined criteria is tagged as a defect, and the pellet description structure is up- 
dated with that defect information. Any given pellet 24 can conceivably have more than one defect, or the spe- 
cific defects found can be more or less serious. 

40 FIGURES 11a and 11b graphically illustrate a preferred decision tree 140 that is used for each potential 

defect or PD. A branch 142 at the flaw type is shown to distinguish between the two pipelines relating to side- 
body surface PDs and edge PDs. In the sidebody defect processing procedure (FIGURE 11a), a branch 144 
into different legs is provided for different handling of crack and non-crack defects. For cracks, the orientation 
of the crack is an aspect of the blob seed parameters, and different length reject thresholds can be applied 

45 via a further branch 146 based on whether the crack is horizontal or vertical. A longitudinal, circumferential 
or end-cap indicating crack over a predetermined length is grounds for rejection. A single short longitudinal 
crack is passed, while a longer crack either generates a rejection or is stored for generating a rejection as a 
thumbnail crack if an additional such crack is found as well. Cracks of other orientations are acceptable unless 
they are longer than a predetermined threshold 148 or are related (e.g., connected) to other cracks. 

50 
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APA-512 GENERATED BLOB PARAMETER 


DESCRIPTION 


Area 


The number of pixels in a blob 


Perimeter 


The length of the perimeter of the blob 




Sum of the x coordinates of all blob pixels 


ry 


Qnm of thfi w coordinates of all blob Dixels 


Ex 2 


Qnm nf thft QnuflrBs of the x coordinates of all blob 
pixels 


2y 2 


Cum rkf thA Qnnarps of the v coordinates of all blob 
pixels 


Xxy 


Sum of the products of the x and y coordinates of all 
blob pixels 


Polarity __ 


whether thp hloh is forearound or backa round 

VVIIwLIICI 11 IO UIUU Iw lUIVylUUim «MW«yi wmm 


Bounding Box 


Minimum and maximum of the x and y coordinates of 
all pixels in the blob 


Structure 


Parent/Child/Sibling relationships; 

Number of holes in the blob; 

Whether or not the blob is on the boundary 



50 



For non-crack defects (FIGURE 11 b), a branch 152 in the decision tree is provided for whether the defect 
is relatively lighter or darker, lighter defects representing metal inclusions or unground surfaces, and darker 
defects representing voids, pits or the like. For these defects, the rejection setpoints 1 54 are based on defect 
area The type of defect detected, the area and the number are likewise used to distinguish good pellets from 
bad ones. Similarly, in the edge defect branch, a PD having an area greater than a predetermined threshold 

generates a rejection decision. 

In addition to generating accept/reject decisions as shown in FIGURES 11a and 11b, and remembenng 
PDs already processed for the particular pellet (for potential rejection due to their number), the system pre- 
ferably logs the defects found. This is useful from a management information standpoint as it enables defects 
to be correlated to manufacturing parameters, pellet lots or batches, particular batches of pellet materials and 
the like. The selection rate can then be improved by correcting or adjusting manufacturing parameters that 
are identified as related to the number of particular defects. 

The invention provides a very consistent and dependable method and apparatus for distinguishing among 
pellets using objective criteria. The subjectivity and variability of human inspection operations are avoided. 
Additionally, the invention eliminates signif icant low-level radiation exposure to human inspectors, and also 
eliminates the need for inspectors to lift and move heavy trays of pellets. 

The invention is applicable to general automated inspection applications. Although the preferred embodi- 
ment described here is specifically intended for inspection of nuclear fuel pellets, which are small cylindrical 
objects, many of the same signal processing techniques and apparatus can be used in other specific surface 
inspection applications. All that is needed is the proper presentation of the object to be inspected to the camera 
and optics. 
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Claims 



1 A method for non-contact surface flaw detection comprising the steps of: 

transporting a succession of workpieces substantially continuously along a path; 
25 illuminating the workpieces at an inspection area; 

recording a plurality of line scans for at least a subset of the workpieces and digitizing the line scans 

to define a pixel data image; L . L u \> , 

processing values of pixels in the image to define an average value, a high threshold and a low 
threshold, the high and low thresholds being within a predetermined range of the average value, and com- 
30 paring the values of the pixels to said high and low thresholds to generate an image map of pixels as a 

result of said comparing; 

counting and associating pixels in the binary image map to detect at least one of parameters in- 
cluding a number of pixels outside the thresholds, at least one dimension of a blob of neighbonng pixels 
outside the thresholds, and correspondence of pixels at an edge of the workpiece wit h a nominal contour; 
35 and, 

selecting and rejecting the workpieces as a function of said parameters. 

2 The method according to claim 1 , wherein the workpieces are cylindrical, and wherein said transporting 
comprises advancing the workpieces along longitudinal axes of the workpieces while rotating the work- 

40 pieces around said axes. 

3 The method according to claim 2, wherein said recording comprises aligning successive line scans of the 
pixel data image to cancel an offset caused by linear displacement of the workpieces between successive 
linescans due to said transporting. 

45 4. The method according to claim 2, wherein the workpieces are cylindrical nuclear fuel pellets. 

5. The method according to claim 4, wherein said processing comprises applying a video finite impulse re- 
sponse filter to the values of the pixels to reduce noise present in the pixel data image. 

so 6. The method according to claim 5, wherein said processing is accomplished on a region of interest corre- 
sponding to a region of associated pixels that contains an image of a workpiece. 

7 The method according to claim 4, wherein said processing further comprises applying a convolution ma- 
trix to a region of interest for ignoring isolated pixels falling outside the thresholds and enhancing contrast 

55 in an area of the edge of the pellets. 

8 The method according to claim 7, wherein said processing further includes applying a second convolution 
matrix for enhancing contrast at the edge of the pellets, and further comprising defining a nominal edge 

11 
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of the pellets from a best fit with the edge as thereby enhanced, and counting and associating pellet edge 
pixels falling outside the thresholds and displaced from the nominal edge, for assessing conformity of 
the pellet edge pixels to the nominal edge. 

5 9. The method according to claim 8, wherein said recording includes storing the image map in an image 
buffer and the processing comprises parallel counting and associating steps for detection of surface flaws 
and edge flaws. 

1 0. The method according to claim 7, further comprising subdividing for processing at least two tiles of pixels 
representing adjacent areas of the pellets, and wherein said counting and associating includes discrim- 

10 inating for blobs in said at least two tiles which bridge across a boundary between the tiles. 

11. The method according to claim 1, wherein the recording is accomplished using a line scanning camera 
having a plurality of sensor elements, and further comprising recording at least one of an offset value 
and a gain value for each of the sensor elements, and normalizing output levels from the sensor elements 

15 to cancel variations in said at least one of the offset value and the gain value among the sensor elements. 

12. A flaw detection apparatus for detecting surface and edge flaws on substantially cylindrical nuclear fuel 
pellets, comprising: 

a transport mechanism operable to rotate and axially advance the pellets along a transport path; 
20 illumination means and a line scan camera, operable to develop a succession of line scan signals 

representing reflectivity of the pellets passing a viewing area; 

means for digitizing the line scan signals to acquire and store in an image buffer a pixel data image 

for the pellets; 

an image data filter comprising at least one of an averaging means, a video finite impulse response 
25 filter and a convolution mask processor, operable to process the pixel data for generating a pixel map 

representing variations in reflectivity of individual said pellets beyond at least one threshold limit; 

a processor operable to analyze the pixel map for identifying grouped blobs of pixels beyond the 
threshold limit and to count at least one of said blobs and said pixels beyond the threshold limit, for as- 
sessing quality of the pellet 

The flaw detect ton apparatus according to clai m 1 2, wherein the image data filter is operable to average values 
of pixels at least within a region of interest and to generate upper and lower thresholds based on the average, 
said pixel map distinguishing between pixels between the thresholds and pixels outside the thresholds. 

The flaw detection apparatus according to claim 13, wherein the average is based at least partly on an 
output of the video finite impulse response filter. 

The flaw detection apparatus according to claim 12, wherein the line scan camera includes a plurality of 
sensor elements, and further comprising means for setting at least one of an offset value and a gain value 
for each of the sensor element, at least one of the means for digitizing, the image data filter and the proc- 
essor being operable to normalize values generated from the sensor elements to cancel variations In said 
at least one of offset and gain. 

The flaw detection apparatus according to claim 12, wherein the image data filter and the processor de- 
fine two parallel image processing pipelines for detecting and assessing side flaws and edge flaws, re- 
spectively. 

The flaw detection apparatus according to claim 13, wherein the image data filter and the processor de- 
fine two substantially parallel image processing pipelines for detecting and assessing side flaws and edge 
flaws, respectively, and wherein the image data filter is operable to enhance contrast of an edge of the 
pellet by application of a convolution mask, the processor being operable to define and count blobs com- 
posed of pixels detected along an extreme edge of the pellet that are displaced from a nominal line that 
best fits the extreme edge. 

18. The flaw detection apparatus according to claim 17, wherein the processor is operable to make an ac- 
55 cept/reject decision for each pellet based on at least one of a count of the blobs, a count of the pixels 

outside the threshold, at least one dimension of the blobs, and the count of pixels along the extreme edge 
that are displaced. 

12 
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